Method and apparatus for augmenting media services

ABSTRACT

A system that incorporates teachings of the present disclosure may include, for example, a media processor that includes a memory and a controller coupled to the memory. The controller can be programmed to receive media content from a set top box where the set top box is a separate device from the media processor and where the media content includes video content. The controller can also be programmed to receive supplemental content from a mobile communication device where the supplemental content is based on reading of a two dimensional bar code by the mobile communication device, and where the supplemental content comprises an image. The controller can further be programmed to generate augmented content by overlaying the supplemental content with the media content and to provide the augmented content to a display device for presentation.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to media services and morespecifically to a method and apparatus for augmenting media services.

BACKGROUND

With the wide availability and variety of services, it is common forconsumers to utilize a single service provider to provide voice, videoand data communication services. This allows the single service providerto exert control over the services being provided, including types ofmedia content and advertising. Consumers often desire more choices inthe services that are available to them.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an illustrative embodiment of a communication system thatprovides media services;

FIG. 2 depicts an illustrative embodiment of a media processor that cansource data from a web source for interacting with the communicationsystem of FIG. 1;

FIG. 3 depicts an illustrative embodiment of a communication deviceutilized in the communication system of FIG. 1;

FIGS. 4-5 depict illustrative embodiments of a portion of the system ofFIG. 1 providing media services;

FIG. 6 depicts illustrative embodiments of a method operating inportions of the systems described in FIGS. 1-5;

FIGS. 7 and 8 depict illustrative embodiments of portions of the systemof FIG. 1 providing media services; and

FIG. 9 is a diagrammatic representation of a machine in the form of acomputer system within which a set of instructions, when executed, maycause the machine to perform any one or more of the methods discussedherein.

DETAILED DESCRIPTION

The present disclosure describes, among other things, illustrativeembodiments for augmenting media services by providing supplementalcontent to be overlayed or otherwise combined with media services beingdelivered to a display device, such as through a set top box. In oneembodiment, a media processor can be coupled with a set top box forreceiving media services from a first service provider and augmentingthe media services with supplemental services that can be received atthe media processor from a source other than the set top box, such asfrom a media server of a second service provider. The media processorcan receive media content from a mobile communication device via thegateway and can combine media content from various sources. Thesupplemental content can be obtained based on an analysis of the mediacontent, including identification of objects depicted in the mediacontent.

In one embodiment, the media content or other data can be provided tothe media processor based on reading of a two dimensional bar code. Thetype of data can vary and can include twitter messages, audio and/orvideo content, still images, text and so forth. Orientation and/ormovement of a device performing the reading can be used by the mediaprocessor to control orientation and/or movement of a display of thesupplemental content on the display device. In one embodiment, the barcode can provide commands to the media processor. In another embodiment,the bar code can be a URL, text, and/or initiate an application launchat the media processor.

One embodiment of the present disclosure includes a media processorhaving a memory and a controller coupled to the memory. The controlleris programmed to receive media content from a set top box where the settop box is a separate device from the media processor and where themedia content comprises video content, and to receive supplementalcontent from a mobile communication device, where the supplementalcontent is based on reading of a two dimensional bar code by the mobilecommunication device, and where the supplemental content comprises animage. The controller is also programmed to generate augmented contentby overlaying the supplemental content with the media content and toprovide the augmented content to a display device for presentation.

One embodiment of the present disclosure is a method including receivingmedia content at a media processor where the media content is receivedfrom a set top box and where the set top box is a separate device fromthe media processor, receiving supplemental content at the mediaprocessor where the supplemental content is received from acommunication device, and generating augmented content by overlaying thesupplemental content with the media content. The method can includereceiving orientation signals at the media processor where theorientation signals are received from the communication device and wherethe orientation signals are based on a first orientation of thecommunication device, and adjusting a second orientation of thesupplemental content in the augmented content based on the orientationsignals.

One embodiment of the present disclosure includes a non-transitorycomputer-readable storage medium. The medium includes computerinstructions to receive media content at a media processor, where themedia content is received from a set top box, where the set top box is aseparate device coupled with the media processor over a hardwire link,where the media content is received at the set top box via a gatewayfrom a first service provider, and where the media content comprisesvideo content. The computer instructions also monitor the media contentusing the media processor, generate a request for supplemental contentat the media processor where the request is based on the monitoring ofthe media content, and transmit the request via the gateway to a mediaserver of a second service provider. The computer instructions alsoreceive supplemental content at the media processor where thesupplemental content is received via the gateway from the media serverof the second service provider and where the supplemental contentcomprises at least one image. The computer instructions further generateaugmented content by overlaying the supplemental content with the mediacontent, and provide the augmented content to a display device forpresentation. The generating of the augmented content can comprisemuxing of video graphics from the media and supplemental content, wherethe muxing is performed based on a request of a user of the mediaprocessor.

FIG. 1 depicts an illustrative embodiment of a first communicationsystem 100 for delivering media content. The communication system 100can represent an Internet Protocol Television (IPTV) media system. TheIPTV media system can include a super head-end office (SHO) 110 with atleast one super headend office server (SHS) 111 which receives mediacontent from satellite and/or terrestrial communication systems. In thepresent context, media content can represent, for example, audiocontent, moving image content such as 2D or 3D videos, video games,virtual reality content, still image content, and combinations thereof.The SHS server 111 can forward packets associated with the media contentto one or more video head-end servers (VHS) 114 via a network of videohead-end offices (VHO) 112 according to a common multicast communicationprotocol.

The VHS 114 can distribute multimedia broadcast content via an accessnetwork 118 to commercial and/or residential buildings 102 housing agateway 104 (such as a residential or commercial gateway). The accessnetwork 118 can represent a group of digital subscriber line accessmultiplexers (DSLAMs) located in a central office or a service areainterface that provides broadband services over fiber optical links orcopper twisted pairs 119 to buildings 102. The gateway 104 can usecommon communication technology to distribute broadcast signals toSet-Top Boxes (STBs) 106, which in turn present broadcast channels tomedia devices 108 such as computers or television sets managed in someinstances by a media controller 107 (such as an infrared or RF remotecontrol).

The gateway 104, the STBs 106, and media devices 108 can utilizetethered communication technologies (such as coaxial, powerline or phoneline wiring) or can operate over a wireless access protocol such asWireless Fidelity (WiFi), Bluetooth, Zigbee, or other present or nextgeneration local or personal area wireless network technologies. By wayof these interfaces, unicast communications can also be invoked betweenthe STBs 106 and subsystems of the IPTV media system for services suchas video-on-demand (VoD), browsing an electronic programming guide(EPG), or other infrastructure services. One or more of the exemplaryembodiments contemplate the media devices 108 being mobile device,including tablets (e.g., a WiFi tablet), smartphones, and so forth.

A satellite broadcast television system 129 can also be used in themedia system of FIG. 1. The satellite broadcast television system 129can be overlaid, operably coupled with, or replace the IPTV system asanother representative embodiment of communication system 100. In thisembodiment, signals transmitted by a satellite 115 carrying mediacontent can be received by a satellite dish receiver 131 coupled to thebuilding 102. Modulated signals received by the satellite dish receiver131 can be transferred to the STBs 106 for demodulating, decoding,encoding, and/or distributing broadcast channels to the media devices108. The STBs 106 can be equipped with a broadband port to the ISPnetwork 132 to enable interactive services such as VoD and EPG asdescribed above.

In yet another embodiment, an analog or digital cable broadcastdistribution system such as cable TV system 133 can be overlaid,operably coupled with, or replace the IPTV system and/or the satelliteTV system as another representative embodiment of communication system100. In this embodiment, the cable TV system 133 can also provideInternet, telephony, and interactive media services. It is contemplatedthat the present disclosure can apply to any present or next generationover-the-air and/or landline media content services system. Some of thenetwork elements of the IPTV media system can be coupled to one or morecomputing devices 130, a portion of which can operate as a web serverfor providing web portal services over an Internet Service Provider(ISP) network 132 to wireline media devices 108 or wirelesscommunication devices 116.

Multiple forms of media services can be offered to media devices overlandline technologies such as those described above. Additionally, mediaservices can be offered to media devices by way of a wireless accessbase station 117 operating according to common wireless access protocolssuch as Global System for Mobile or GSM, Code Division Multiple Accessor CDMA, Time Division Multiple Access or TDMA, Universal MobileTelecommunications or UMTS, World interoperability for Microwave orWiMAX, Software Defined Radio or SDR, Long Term Evolution or LTE, and soforth. Other present and next generation wide area wireless networktechnologies are contemplated by the present disclosure. System 100 caninclude a media processor 150 coupled to the STB 106 and the displaydevice 108, such as through a hardwire link, although the presentdisclosure also contemplates use of a wireless connection. The mediaprocessor 150 can receive media services from the STB 106, such as videocontent that is intended to be displayed on the display device 108. Themedia processor 150 can receive supplemental services, such as stillimages, video content, data and so forth from a source other than theSTB 106. In one embodiment, the supplemental content can be received bythe media processor 150 from the gateway 104, such as via a wirelessconnection with the gateway 104. The media processor 150 allows forsimultaneous receipt of all or a portion of media services from aplurality of sources, which can include the STB 106, a media server viathe gateway 104, and/or a mobile device 116 (e.g., via the gateway 104).The media processor 150 can overlay content that is currently beingreceived and/or overlay recorded content, including content stored atthe media processor 150 and/or stored at another device for presentationat the display device 108 (e.g., a TV). The media processor 150 caninclude a number of different components, such as an input/output forHD, SD and/or 3D content. The media processor 150 can also include avideo/graphics multiplexer that acts as a video graphics proxy to mix orotherwise combine multiple data (including multiple data types) frommultiple sources.

The media processor 150 can combine the media services and thesupplemental services for presentation at the display device 108. Forexample, the media processor 150 can overlay the supplemental serviceson the media services. The overlay can be generated based on a number offactors, including user preferences, user profiles, viewing history,type of media content being presented and so forth.

The media processor 150 can obtain the supplemental content in a numberof different ways. In one embodiment, the supplemental content can beobtained based on an analysis of the media content being provided by theSTB 106. For example, image recognition can be applied to images of themedia content to identify particular objects in the media content.Supplemental content can be requested by the media processor 150 via thegateway 104 from a content source, including from a different serviceprovider. The supplemental content can be of various forms, includingadvertisement or marketing information, related information such assimilar movies or actor's biographies, and so forth. In anotherembodiment, the media processor 150 can determine when a user isrequesting particular content, such as ordering a VOD movie via the STB106 and can provide alternative viewing for the movie, such as from adifferent source or a different version (e.g., HD version, G-ratedversion, and so forth). In one example, the media processor 150 canprovide alternative sources, including alternate service providers,based on cost differentials, such as where the VOD movie costs more toorder via the STB 106 than the same movie available over the Internet.

In another embodiment, the supplemental content can be obtained based onpreferences and/or selections of the user. For example, the user canhave preferences established, such as through a user profile, whichindicate a desire to see actor biographies when a movie is beingwatched.

In yet another embodiment, the supplemental content can be unrelated tothe media content being received from the STB 106. For example, thesupplemental content can be weather and/or traffic conditions, localnews headlines, and so forth. The supplemental content can also beunrelated to the media services of the STB 106 but related to theparticular viewer, such as emails, instant messages and so forth.

In one embodiment, media processor 150 can include storage medium 162which can have computer instructions for translating orientation and/ormovement of a bar code reading device into orientation and/or movementof a display of the supplemental content on the display device 108. Forexample, a mobile device 116 can include a bar code reader whichtransmits data acquired from a bar code to the media processor 150, suchas wirelessly via the gateway 104. The mobile device 116 can alsotransmit position data including orientation and/or movement dataassociated with the mobile device 116 (such as with respect to theposition of the bar code), which is then utilized by the media processor150 to control the presentation of the supplemental content that isbeing displayed based on the bar code data.

For instance, a user can rotate the mobile device 116 which causes anobject generated from two dimensional bar code data to be rotated on thedisplay device 108. In another example, other commands entered at themobile device 116 can be utilized to manipulate the object beingpresented at the display device 108, such as in conjunction with theorientation and/or movement data. For instance, the object can be a carbeing presented at the display device 108. The mobile device 116 can bemanipulated (e.g., changing orientation and/or position of the devicewith respect to the bar code) so as to present a view of the trunk ofthe car on the display device 108. Another command signal (e.g.,depressing a button on the mobile device) can subsequently be receivedfrom the mobile device 116 which can cause the trunk, which is beingdepicted on display device 108, to open.

The bar code reader can be a component of the mobile device 116 thatallows for real-time reading and transmission of bar code data, such asthrough use of computer instructions stored in storage medium 164. Inanother embodiment, the mobile device 116 can utilize a camera (e.g.,integrated with the mobile device 116) to capture an image of the barcode and can analyze the image to acquire the bar code data. In thisexample, the orientation and/or movement of the mobile device 116 doesnot need to be with respect to the bar code, but rather can be withrespect to some other focal point (including internal). The mobiledevice 116 can utilize various components and/or techniques to determinethe orientation and/or movement data, such as an accelerometer or agyroscope.

System 100 provides a media processor 150 that can mux video graphicsfrom multiple sources and present the augmented content on demand. Themedia processor can communicate with an STB 106 of a first serviceprovider, while the media processor is provided via a second serviceprovider, and can receive supplemental content from the second serviceprovider. The media processor 150 also allows for acquiring variousinformation from a two dimensional bar code for presentation at adisplay device.

FIG. 2 depicts an illustrative embodiment of an Internet or web source202, which can be used in conjunction with media processor 150. Forinstance, the web source 202 can be a source of media content accessedby the media processor 150, where one or more applications beingexecuted at the media processor 150 can retrieve content from the websource and can combine the supplemental content received from the websource with content being received from the STB 106. The web source 202can be hosted by server applications operating from the computingdevices 130 of the communication system 100 illustrated in FIG. 1. Inone embodiment, the web source 202 can be used for managing otherservices of communication system 100, while media processor 150 is usedfor managing the overlay of supplemental content with the media contentprovided via STB 106. In one embodiment, the media processor 150 can beconfigured, for example, to access a Digital Video Recorder (DVR), aVideo on Demand (VoD) catalog, an Electronic Programming Guide (EPG), ora personal catalog (such as personal videos, pictures, audio recordings,etc.) stored in the STB 106. The web portal 202 can be used forprovisioning IMS services described earlier, provisioning Internetservices, provisioning cellular phone services, and so on. One or moreof the exemplary embodiments contemplate sourcing supplemental content,which can include audio and/or video content, data and so forth, to themedia processor 150 from various sources, including more than oneservice provider. In one embodiment, a cloud computing configuration canbe utilized for sourcing a portion of the data to the media processor150.

FIG. 3 depicts an exemplary embodiment of a communication device 300.Communication device 300 can serve in whole or in part as anillustrative embodiment of the devices depicted in FIG. 1. Thecommunication device 300 can comprise a wireline and/or wirelesstransceiver 302 (herein transceiver 302), a user interface (UI) 304, apower supply 314, a location receiver 316, and a controller 306 formanaging operations thereof. The transceiver 302 can support short-rangeor long-range wireless access technologies such as Bluetooth, WiFi,Digital Enhanced Cordless Telecommunications (DECT), or cellularcommunication technologies, just to mention a few. Cellular technologiescan include, for example, CDMA-1X, UMTS/HSDPA, GSM/GPRS, TDMA/EDGE,EV/DO, WiMAX, SDR, LTE, as well as other next generation cellularwireless communication technologies as they arise. The transceiver 302can also be adapted to support circuit-switched wireline accesstechnologies (such as PSTN), packet-switched wireline accesstechnologies (such as TCPIP, VoIP, etc.), and combinations thereof.

The UI 304 can include a depressible or touch-sensitive keypad 308 witha navigation mechanism such as a roller ball, a joystick, a mouse, or anavigation disk for manipulating operations of the communication device300. The keypad 308 can be an integral part of a housing assembly of thecommunication device 300 or an independent device operably coupledthereto by a tethered wireline interface (such as a USB cable) or awireless interface supporting for example Bluetooth. The keypad 308 canrepresent a numeric dialing keypad commonly used by phones, and/or aQwerty keypad with alphanumeric keys. The UI 304 can further include adisplay 310 such as monochrome or color LCD (Liquid Crystal Display),OLED (Organic Light Emitting Diode) or other suitable display technologyfor conveying images to an end user of the communication device 300. Inan embodiment where the display 310 is touch-sensitive, a portion or allof the keypad 308 can be presented by way of the display 310 with itsnavigation features.

The UI 304 can also include an audio system 312 that utilizes commonaudio technology for conveying low volume audio (such as audio heardonly in the proximity of a human ear) and high volume audio (such asspeakerphone for hands free operation). The audio system 312 can furtherinclude a microphone for receiving audible signals of an end user. Theaudio system 312 can also be used for voice recognition applications.The UI 304 can further include an image sensor 313 such as a chargedcoupled device (CCD) camera for capturing still or moving images.

The power supply 314 can utilize common power management technologiessuch as replaceable and rechargeable batteries, supply regulationtechnologies, and charging system technologies for supplying energy tothe components of the communication device 300 to facilitate long-rangeor short-range portable applications. The location receiver 316 canutilize common location technology such as a global positioning system(GPS) receiver capable of assisted GPS for identifying a location of thecommunication device 300 based on signals generated by a constellationof GPS satellites, thereby facilitating common location services such asnavigation.

The communication device 300 can also use the transceiver 302 todetermine a proximity to a cellular, WiFi, Bluetooth, or other wirelessaccess points by common sensing techniques such as utilizing a receivedsignal strength indicator (RSSI) and/or a signal time of arrival (TOA)or time of flight (TOF). The controller 306 can utilize computingtechnologies such as a microprocessor, a digital signal processor (DSP),and/or a video processor with associated storage memory such a Flash,ROM, RAM, SRAM, DRAM or other storage technologies.

The communication device 300 can be adapted to perform the functions ofthe STBs 106, the media processor 150, the media devices 108, or theportable communication devices 116 of FIG. 1. It will be appreciatedthat the communication device 300 can also represent other commondevices that can operate in communication system 100 of FIG. 1, such asa gaming console and a media player.

Communication device 300 can include a detector 350 for determining theposition and/or movement of the communication device 300. For instance,detector 350 can include one or more components and can apply one ormore techniques for determining and generating position datacorresponding to an orientation and/or movement of the communicationdevice 300. The position data can be transmitted from the communicationdevice 300 to the media processor 150, such as via the gateway 104. Inone embodiment, communication device 300 can include a bar code readerfor reading single and/or multi-dimensional bar codes.

It is further contemplated that the communication device 300 can operateas an STB, a portable communication device or a server performing thefunctions described with respect to storage mediums 162 and 164, asdescribed earlier. Illustrative embodiments of methods that can operatein portions of the communication device 300 of FIG. 3 are describedbelow.

FIG. 4 depicts a portion of a communication system 400, such as system100 of FIG. 1. The media processor 150 can receive media services fromthe STB 106, such as scheduled programming 425 of an auto race. In thisembodiment, the STB 106 can receive the programming 425 from a serviceprovider network via the gateway 104 and can deliver the services to themedia processor 150 via a hardwire link. The media processor 150 canreceive supplemental content 450, which in this example is an image ofan automobile, from another source (e.g., a mobile device 116) via thegateway 104. In this example, the media processor 150 can have awireless connection with the gateway 104 so that the supplementalcontent bypasses the STB 106.

The media processor 150 can combine the supplemental content 450 withthe programming 425 and deliver augmented content 460 for presentationat the display device 108. The augmented content 460 can be presented invarious formats. For example, the supplemental content 450 can beoverlayed with the programming 425. In one embodiment, the mediaprocessor 150 can determine a display position to overlay thesupplemental content 450 in order to reduce interference or blocking ofobjects in the programming 425. For example, the media processor 150 candetermine that the programming 425 is an auto race where the bottomright portion of the display has the least number of objects. Othercriteria and techniques can also be used for determining theconfiguration of the augmented content, such as user preferences, userprofiles, types of content, metadata and so forth.

In one embodiment, the mobile device 116 can receive and/or retrieve thesupplemental content 450 from a service provider that is different fromthe service provider associated with the programming 425. Thesupplemental content 450 can be supplied at the request of a user of themobile device 116 and/or can be requested by the media processor 150.For example, the media processor 150 can analyze the programming 425 andrequest supplemental content 450 that is related to the programming 425,such as an advertisement of an automobile of the same brand that is inthe lead in the auto race of the programming 425. In this example, thecontext of the programming 425 can be utilized for requesting thesupplemental content 450. The context in this example is the leader ofthe race of programming 425. However, other context information can alsobe utilized in the present disclosure, such as an actor singing a songin a movie. In such an example, the supplemental content can be otherindividuals that have sung the same song or other songs sung by the sameactor. The context can be determined by media processor 150 in a numberof different ways, including using image recognition to identify objectsin video content, metadata describing particular portions ofprogramming, and so forth.

In one embodiment, other sources, such as cloud services 475, candeliver media services to the media processor 150 for presentation atthe display device 108. The media processor 150 can overlay mediacontent from any number of different sources, which can include themedia services provided by the STB 106. The various media content can bedelivered simultaneously and/or at different times (and recorded) inorder to be combined into the augmented content 460.

In one embodiment, media processor 150 can provide an embedded platformfor adding gesture-based services to existing media services 425, suchas through use of the mobile device 116. The mobile device 116 can beutilized to control presentation of the augmented content 460, includingthrough monitoring the orientation and/or movement of the mobile device116 and translating any changes to the view being presented at thedisplay device 108. In another embodiment, services can be stored at themedia processor 150 to enhance access speed.

System 400 allows for providing augmented content through use of one ormore applications being executed at the media processor 150. The mediaprocessor 150 can retrieve data from a variety of sources, and caninclude a multiplexer for muxing video graphics for presentation at atelevision or the like.

FIG. 5 illustrates one example of a composite overlay 575 that can begenerated by the media processor 150 based on a TV layer 525 receivedfrom the STB 106 and based on an overlay service layer 550 received froma source other than the STB 106. In this embodiment, the overlay servicelayer 550 comprises information that is unrelated to the TV layer 525,such as weather information and email information. The information forthe overlay service layer 550 can be retrieved from various sources,including wirelessly from a personal computer in the residence. The usercan customize the overlay service layer 550 as desired, including thesize and positioning of various information. In one embodiment, userpreferences and/or user profiles can be utilized for determining how thecomposite overlay 575 is to be generated, including whether it is onlyto be generated during particular time frames or types of media content.

FIG. 6 depicts an illustrative method 600 that describes operations ofone or more devices of FIGS. 1-5. Method 600 illustrates the receipt,muxing and presentation of video graphics and/or other data frommultiple sources, which can include an STB. Method 600 also provides forpresentation of content at a display device where the presentation issensitive to changes in the orientation and/or position of the devicesourcing the content, such as a smart-phone. Method 600 can begin at 602in which media services (e.g., video content) are received at the mediaprocessor 150 from the STB 106. In one embodiment at 604, the mediaservices, such as content being delivered, can be analyzed. The analysiscan be based on a number of techniques including image and/or audiorecognition, metadata and so forth. In one embodiment, the analysis caninclude identifying objects being presented in an image and determininga context for the object. For example, the media processor 150 can applyimage recognition to programming of an auto race as shown in FIG. 4.Based on the image recognition, the media processor 150 can identify oneof the cars as a particular make and model. The media processor 150 canalso determine the context of the image to be the particular car in thelead of an auto race. For example, the contextual analysis can be basedon determining a subject matter of the content which is a sporting eventand the type of sporting event which is an auto race. The contextualanalysis can also determine criteria associated with auto races, such asthe winner being the lead car. Based on the recognized image and thecontext, at 606 the media processor 150 can request content associatedwith the identified car but for a high-performance model based on thecontext of the race. The requested supplemental content can be anadvertisement for the car and/or can be non-marketing material, such asother races in which that particular make and model of the car has wonthe race. In another embodiment, the recognition of the car by the mediaprocessor 150 can be utilized to determine other related content, suchas a biography of the car driver. Thus, media processor 150 can utilizerecognition of a first object in the content (the car) to determine theidentity of a second object (the driver) in the content, such as basedon other information associated with the first object without the needto perform recognition on the second object.

At 608, the media processor 150 can receive the supplemental content.The supplemental content can be received from various sources, includingdifferent service providers. At 610, the media processor 150 candetermine whether the content is sensitive to orientation and/ormovement. For example, the media processor 150 can determine whetherdifferent views of the supplemental content can be presented, such asbased on movement of the source device. If the supplemental content isnot capable of being presented with different views or is otherwise notadjustable based on movement of the source device, at 612 the mediaprocessor 150 may overlay the supplemental content with the mediaservices and provides augmented content to the display device forpresentation.

If on the other hand, the supplemental content is orientation and/ormovement sensitive, then at 614 the supplemental content can bepresented, such as in an overlay with the other media services, and at616 the presentation of the supplemental content can be adjusted basedon position changes of the source device, such as changes to theorientation and/or other movement.

FIG. 7 depicts a portion of a communication system 700, such as system400 of FIG. 4. The media processor 150 can receive media services fromthe STB 106, such as scheduled programming 725 of an auto race. In thisembodiment, the STB 106 can receive the programming 725 from a serviceprovider network via the gateway 104 and can deliver the services to themedia processor 150 via a hardwire link. The media processor 150 canreceive supplemental content 712, which in this example is an image ofan automobile, from another source (e.g., the mobile device 116) via thegateway 104. In this example, the media processor 150 can have awireless connection with the gateway 104 so that the supplementalcontent bypasses the STB 106.

The media processor 150 can overlay the supplemental content 712 withthe programming 725 to deliver augmented content 760. In thisembodiment, the supplemental content is obtained by the mobile device116 from a two-dimensional bar code 710 that is included on a medium705, such as a brochure, advertising leaflet, magazine and so forth.Other mediums can be utilized for supplying the two-dimensional barcode, such as the mobile device 116 reading the bar code from the screenof another display device. In one embodiment, the mobile device 116 caninclude a bar code reader that can be passed over the bar code 710. Forinstance, the bar code reader can generate a focus window 715 which isthe boundary for data of the bar code that will be presented by themedia processor 150. The focus window 715 can be illustrated as a guidewindow 717 on a display of the mobile device 116, which can include theentire image represented by the bar code if the reader has alreadycaptured all of the necessary data to generate such an image at themobile device display. The image portion 750 within the focus window 715can be presented at the display device 108. As the focus window 715 ismoved with respect to the bar code 710, the image portion 750 can bechanged to reflect the movement. In this example, the user can laterallymove the mobile device 116 with respect to the bar code 710 to presentat the display device 108 different portions of the image of the car.

The use of bar code 710 can also facilitate generation of the augmentedcontent 760. For example, in one embodiment a user can begin scanningthe bar code 710 using the reader of the mobile device 116 whichinitiates the presentation of the augmented content 760 at the displaydevice 108 without the need for the user to enter any other informationor any other user actions. The exemplary embodiments describe use of abar code reader of the mobile device 116, however, it is alsocontemplated that the bar code can be read by capturing an image of thebar code utilizing a camera of the mobile device and then processing theimage to determine the bar code data. In this example, the mobile device116 can present the guide window 717 in its display which is adjustableby the user, such as through keystrokes, screen gestures and/or movementof the mobile device 116. As described above, the guide window 717 andits movement can be utilized by the media processor 150 to manipulatethe presentation of the image portion 750.

One or more of the exemplary embodiments contemplate the bar code 710including information associated with one or more of the following:processor commands, application launching, URL's, text, images, audioand so forth. Media processor 150 can utilize the information from thebar code to perform various functions, including presentation of text,images and/or audio, as well as launching applications at the mediaprocessor or accessing a website having a particular URL.

FIG. 8 depicts a portion of a communication system 800, such as system400 of FIG. 4. The media processor 150 can receive supplemental content750, which in this example is an image of an automobile, from anothersource (e.g., the mobile device 116). In this example, the mediaprocessor 150 can have a wireless connection with a gateway so that thesupplemental content 750 bypasses any STB.

The supplemental content 750 can be obtained by the mobile device 116 ina number of different ways, such as from the two-dimensional bar code710 that is included on the medium 705. In one embodiment, position datacan be transmitted from the mobile device 116 to the media processor 150along with bar code data, where the position data represents anorientation and/or a movement of the mobile device 116. The positiondata can be relative to the bar code 710 and/or can be relative to someother focal point. A first position change 825 (e.g., rotating 30degrees as illustrated in FIG. 8) can be translated by the mediaprocessor 150 into a second position change 850 of the supplementalcontent 750. In this example, the movement of the mobile device 116 istranslated directly into the corresponding movement of the supplementalcontent 750 based on a one-to-one correspondence. However, othertechniques can also be utilized, such as utilizing proportionaltranslations of movement (e.g., a 2:1 translation resulting in a 60degree rotation of the mobile device 116 being translated into a 30degree rotation of the supplemental content 750).

The position data can also be used for other manipulation of thesupplemental content 750. For instance, the movement of the mobiledevice 116 can provide access to areas of an image that are blocked inother views of the image. As an example, the mobile device 116 can berotated and moved so as to go from an outside view of the side of thecar of supplemental content 750 to an inside view of the inside of thecar door. This may be done by rotating and moving the mobile device 116along the corresponding path. In another embodiment, user commands otherthan the rotation and movement of the mobile device 116 can be utilizedto manipulate the supplemental content 750. For example, depressing akey on the mobile device 116 can cause a car door to open so that theuser can then “travel” into the car based on rotation and movement ofthe mobile device 116. In another example, depressing a different keycan cause the depicted engine key to turn and result in audio of theengine starting, along with other information being presented that isassociated with the engine performance.

In one embodiment, the rotation and movement of the mobile device 116can be utilized to manipulate the presentation of supplemental contentthat is not being obtained from a bar code. For example, the mediaprocessor 150 can retrieve images that have three dimensional features.Position signals can be transmitted from the mobile device 116 based ona rotation and/or other movement of the mobile device 116. The positionsignals can then be utilized to manipulate the presentation of thesupplemental content as described above.

Upon reviewing the aforementioned embodiments, it would be evident to anartisan with ordinary skill in the art that said embodiments can bemodified, reduced, or enhanced without departing from the scope andspirit of the claims described below. For example, the media processorcan be utilized to promote competitor media services. As an example,media content that is being viewed can be analyzed as to cost andquality, and alternative providers can be presented by the mediaprocessor 150 which would be accessed via the media processor 150. Inthis example, the STB may be operated by a first service provider whilethe media processor may be associated with a second service provider. Inanother embodiment, multiple media processors 150 can be utilized thatare in communication with each other, such as via wireless linksdirectly or via a gateway. Processing resources and/or stored contentcan be shared amongst the processors to facilitate delivery of augmentedcontent to multiple display devices 108. In another embodiment, themedia processors 150 can be multi-mode devices that are capable ofcommunicating using various modes, such as WiFi and Bluetooth and canrecognize various mobile devices that are in proximity.

In another embodiment, the retrieval of the supplemental content can bebased on identifying a channel being viewed by a user and determiningprogramming that is being presented by the channel at that particulartime. The subject matter of the known programming can then be used todetermine or otherwise request the supplemental content by the mediaprocessor 150.

In one embodiment, supplemental content can come from an application(s)on the media processor 150 and/or from media services on Internet via amobile device. The mobile device can be the command/control unit, whilemuxing of the content can be performed via the media processor 150.

FIG. 9 depicts an exemplary diagrammatic representation of a machine inthe form of a computer system 900 within which a set of instructions,when executed, may cause the machine to perform any one or more of themethods discussed above. One or more instances of the machine canoperate, for example, as the STB 106, the mobile communication device116, and the server 130 or combinations thereof as described above. Insome embodiments, the machine may be connected (e.g., using a network)to other machines. In a networked deployment, the machine may operate inthe capacity of a server or a client user machine in server-client usernetwork environment, or as a peer machine in a peer-to-peer (ordistributed) network environment.

The machine may comprise a server computer, a client user computer, apersonal computer (PC), a tablet PC, a smart phone, a laptop computer, adesktop computer, a control system, a network router, switch or bridge,or any machine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. It will beunderstood that a communication device of the present disclosureincludes broadly any electronic device that provides voice, video ordata communication. Further, while a single machine is illustrated, theterm “machine” shall also be taken to include any collection of machinesthat individually or jointly execute a set (or multiple sets) ofinstructions to perform any one or more of the methods discussed herein.

The computer system 900 may include a processor 902 (e.g., a centralprocessing unit (CPU), a graphics processing unit (GPU, or both), a mainmemory 904 and a static memory 906, which communicate with each othervia a bus 908. The computer system 900 may further include a videodisplay unit 910 (e.g., a liquid crystal display (LCD), a flat panel, ora solid state display. The computer system 900 may include an inputdevice 912 (e.g., a keyboard), a cursor control device 914 (e.g., amouse), a disk drive unit 916, a signal generation device 918 (e.g., aspeaker or remote control) and a network interface device 920.

The disk drive unit 916 may include a tangible computer-readable storagemedium 922 on which is stored one or more sets of instructions (e.g.,software 924) embodying any one or more of the methods or functionsdescribed herein, including those methods illustrated above. Theinstructions 924 may also reside, completely or at least partially,within the main memory 904, the static memory 906, and/or within theprocessor 902 during execution thereof by the computer system 900. Themain memory 904 and the processor 902 also may constitute tangiblecomputer-readable storage media. An input/output 950 can be utilized forHD, SD and/or 3D content. A video/graphics multiplexer 975 can also beincluded that acts as a video graphics proxy to mix or otherwise combinemultiple data (including multiple data types) from multiple sources. Forexample, the media processor 150 can include these components whichallows for receiving multiple content from multiple sources, mixing ofthe content, and outputting the mixed content for display at atelevision or the like.

Dedicated hardware implementations including, but not limited to,application specific integrated circuits, programmable logic arrays andother hardware devices can likewise be constructed to implement themethods described herein. Applications that may include the apparatusand systems of various embodiments broadly include a variety ofelectronic and computer systems. Some embodiments implement functions intwo or more specific interconnected hardware modules or devices withrelated control and data signals communicated between and through themodules, or as portions of an application-specific integrated circuit.Thus, the example system is applicable to software, firmware, andhardware implementations.

In accordance with various embodiments of the present disclosure, themethods described herein are intended for operation as software programsrunning on a computer processor. Furthermore, software implementationscan include, but not limited to, distributed processing orcomponent/object distributed processing, parallel processing, or virtualmachine processing can also be constructed to implement the methodsdescribed herein.

While the tangible computer-readable storage medium 922 is shown in anexample embodiment to be a single medium, the term “tangiblecomputer-readable storage medium” should be taken to include a singlemedium or multiple media (e.g., a centralized or distributed database,and/or associated caches and servers) that store the one or more sets ofinstructions. The term “tangible computer-readable storage medium” shallalso be taken to include any non-transitory medium that is capable ofstoring or encoding a set of instructions for execution by the machineand that cause the machine to perform any one or more of the methods ofthe present disclosure.

The term “tangible computer-readable storage medium” shall accordinglybe taken to include, but not be limited to: solid-state memories such asa memory card or other package that houses one or more read-only(non-volatile) memories, random access memories, or other re-writable(volatile) memories, a magneto-optical or optical medium such as a diskor tape, or other tangible media which can be used to store information.Accordingly, the disclosure is considered to include any one or more ofa tangible computer-readable storage medium, as listed herein andincluding art-recognized equivalents and successor media, in which thesoftware implementations herein are stored.

Although the present specification describes components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the disclosure is not limited to such standards andprotocols. Each of the standards for Internet and other packet switchednetwork transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP) representexamples of the state of the art. Such standards are from time-to-timesuperseded by faster or more efficient equivalents having essentiallythe same functions. Wireless standards for device detection (e.g.,RFID), short-range communications (e.g., Bluetooth, WiFi, Zigbee), andlong-range communications (e.g., WiMAX, GSM, CDMA) are contemplated foruse by computer system 900.

The illustrations of embodiments described herein are intended toprovide a general understanding of the structure of various embodiments,and they are not intended to serve as a complete description of all theelements and features of apparatus and systems that might make use ofthe structures described herein. Many other embodiments will be apparentto those of skill in the art upon reviewing the above description. Otherembodiments may be utilized and derived therefrom, such that structuraland logical substitutions and changes may be made without departing fromthe scope of this disclosure. Figures are also merely representationaland may not be drawn to scale. Certain proportions thereof may beexaggerated, while others may be minimized. Accordingly, thespecification and drawings are to be regarded in an illustrative ratherthan a restrictive sense.

Although specific embodiments have been illustrated and describedherein, it should be appreciated that any arrangement calculated toachieve the same purpose may be substituted for the specific embodimentsshown. This disclosure is intended to cover any and all adaptations orvariations of various embodiments. Combinations of the aboveembodiments, and other embodiments not specifically described herein,will be apparent to those of skill in the art upon reviewing the abovedescription.

The Abstract of the Disclosure is provided with the understanding thatit will not be used to interpret or limit the scope or meaning of theclaims. In addition, in the foregoing Detailed Description, it can beseen that various features are grouped together in a single embodimentfor the purpose of streamlining the disclosure. This method ofdisclosure is not to be interpreted as reflecting an intention that theclaimed embodiments require more features than are expressly recited ineach claim. Rather, as the following claims reflect, inventive subjectmatter lies in less than all features of a single disclosed embodiment.Thus the following claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separately claimedsubject matter.

What is claimed is:
 1. A media processor, comprising: a memory; and acontroller coupled to the memory and programmed to: receive mediacontent from a set top box, wherein the set top box is a separate devicefrom the media processor, and wherein the media content comprises videocontent; receive supplemental content from a mobile communicationdevice, wherein the supplemental content is based on reading of a twodimensional bar code by the mobile communication device, and wherein thesupplemental content comprises an image; generate augmented content byoverlaying the supplemental content with the media content; and providethe augmented content to a display device for presentation.
 2. The mediaprocessor of claim 1, wherein the controller is programmed to: receiveposition data from the mobile communication device, wherein the positiondata represents at least one orientation and movement of the mobilecommunication device, and wherein the position data includes a firstposition of the mobile communication device when reading the twodimensional bar code; and adjust a second position of the supplementalcontent in the augmented content based on the position data.
 3. Themedia processor of claim 2, wherein the controller is programmed toadjust the second position to correspond with the first position.
 4. Themedia processor of claim 1, wherein the supplemental content comprises aportion of the image represented by the two dimensional bar code thatcorresponds with a reading window generated by the mobile communicationdevice.
 5. The media processor of claim 1, wherein at least a portion ofthe supplemental content is received by the controller simultaneouslywith receipt of the media content from the set top box.
 6. The mediaprocessor of claim 1, wherein the set top box is in communication with aremote media server via a gateway to access the media content, andwherein the supplemental content is received from the mobilecommunication device via the gateway.
 7. The media processor of claim 6,wherein the controller is programmed to receive the media content over ahardwire link with the set top box and to receive the supplementalcontent over a wireless link with the gateway.
 8. A method comprising:receiving media content at a media processor, wherein the media contentis received from a set top box, and wherein the set top box is aseparate device from the media processor; receiving supplemental contentat the media processor, wherein the supplemental content is receivedfrom a communication device; generating augmented content by overlayingthe supplemental content with the media content; receiving orientationsignals at the media processor, wherein the orientation signals arereceived from the communication device, and wherein the orientationsignals are based on a first orientation of the communication device;and adjusting a second orientation of the supplemental content in theaugmented content based on the orientation signals.
 9. The method ofclaim 8, wherein the media content and the supplemental content comprisevideo content.
 10. The method of claim 8, wherein the communicationdevice is a mobile device configured for voice communications.
 11. Themethod of claim 8, comprising: receiving movement signals at the mediaprocessor, wherein the movement signals are received from thecommunication device, wherein the movement signals are based on a firstposition of the communication device; adjusting a second position of thesupplemental content in the augmented content based on the movementsignals; and providing the augmented content to a display device forpresentation.
 12. The method of claim 8, wherein the supplementalcontent is based on reading of a two dimensional bar code by thecommunication device.
 13. The method of claim 12, wherein thecommunication device is a mobile device, and wherein the supplementalcontent comprises a portion of an image represented by the twodimensional bar code that corresponds with a reading window generated bythe mobile communication device.
 14. The method of claim 8, wherein themedia content is received at the media processor via a gateway from afirst service provider, and wherein the supplemental content is receivedat the media processor via the gateway from a second service provider.15. The method of claim 8, wherein the media content is received at themedia processor over a hardwire link with the set top box, and whereinthe supplemental content is received at the media processor over awireless link with the gateway.
 16. A non-transitory computer-readablestorage medium comprising computer instructions to: receive mediacontent at a media processor, wherein the media content is received froma set top box, wherein the set top box is a separate device coupled withthe media processor over a hardwire link, wherein the media content isreceived at the set top box via a gateway from a first service provider,and wherein the media content comprises video content; monitor the mediacontent using the media processor; generate a request for supplementalcontent at the media processor, wherein the request is based on themonitoring of the media content; transmit the request via the gateway toa media server of a second service provider; receive supplementalcontent at the media processor, wherein the supplemental content isreceived via the gateway from the media server of the second serviceprovider, wherein the supplemental content comprises at least one image;generate augmented content by overlaying the supplemental content withthe media content, wherein the generating of the augmented contentcomprises muxing of video graphics from the media and supplementalcontent, and wherein the muxing is performed based on a request of auser of the media processor; and provide the augmented content to adisplay device for presentation.
 17. The non-transitorycomputer-readable storage medium of claim 16, wherein the monitoring ofthe media content includes performing image recognition on the mediacontent to identify objects depicted in the media content, wherein therequest for the supplemental content is based on the objects.
 18. Thenon-transitory computer-readable storage medium of claim 16, comprisingcomputer instructions to receive additional content at the mediaprocessor, wherein the additional content is received from a mobilecommunication device via the gateway, wherein the augmented content isgenerated by overlaying the additional content and the supplementalcontent with the media content.
 19. The non-transitory computer-readablestorage medium of claim 18, wherein at least a portion of the additionalcontent and at least a portion of the supplemental content are receivedby the media processor simultaneously with receipt of the media content.20. The non-transitory computer-readable storage medium of claim 18,wherein the additional content is based on reading of a two dimensionalbar code by the mobile communication device, and further comprisingcomputer instructions to: receive position data from the mobilecommunication device, wherein the position data comprises at least oneof orientation information and movement information for the mobilecommunication device, wherein the position data includes a firstposition of the mobile communication device when reading the twodimensional bar code; and adjust a second position of the additionalcontent in the augmented content based on the position data.